FIS920030289US1 



1/17 



CO 

c 
2 

CO 
» 

03 

Q 









ffei 






c 


CO 


CO 


CO 
-«— » 


CO 


CO 


CO 


Q 


Q 







o 




tLogi 




O 


o 




RNI 











0 

•4— » 






c 




'c 


o 






O 




c 


c 




o 


_o 










CO 


o 






0 






c 




"co 


C 




> 


o 






O 








0) 

o 

■g 

CD 



ooi 



2 



SI 



CD 
O 
CO 
Q_ 
CO 

I— 

0 

CO 

ZD 



si 

0 

"O 
O 



CO 

c 

0 





2 








C 




o 




O 




CO 




CO 




0 




o 




o 




< 



Ml 

0 
O 

l_ 

o 

CO 
CO 

-♦— » 

CO 

Q 



£2 

CD 
05 
03 
O 



si 

CO 

c 

03 
i_ 

H 

03 
CO 

Q 



FIS920030289US1 



2/17 



< 




FIS920030289US1 



112 



3/17 

FIG. 1C 

Prior Art 



112NA 



164 



Case A: 



166 



Case B: 



IE? 



160^ 168 



Case C: 



168 



Case D: 



168 



Case E: 



160 ^162 



162 



162 



162 



162 



Legend: 

i i DDP payload 
t:::::::::J DDP header 
■ Marker 



FIS920030289US1 



4/17 



FIG. ID 

Prior Art 



0 12 3 

01234567890123456789012345678901 



TL Rsvd DV RsvdULP 



STag 



TO 



/ 

124 



FIG. IE 

Prior Art 



0 12 3 

01234567890123456789012345678901 



TL 



Rsvd 



DV 



RsvdULP[0:7] 



RsvdULP[8:39] 
QN 
MSN 

MO 



/ 

124 



FIS920030289US1 



200 208S^ 

\ ) Send WR posted 
by consumer 




Requester 5/17 Responder FIG. IF 

208R Prior Art 



216S 



Send, 300 bytes 




210S 



242 



Send WR 
Completion 




240 



RNIC 
4 



220 

/ 

Send (Untagged, SN=1 00). 

Send (Untagged, SN=200)_ 

Send (Untagged, SN=300, Lasfj 

TCP Ack, SN=200- 
TCPAck, SN=300" 




Receive WR posted 
by consumer 



21 6R 




240 



Receive WR 
Completion 




Write WR posted 
by consumer 



216W ^208W, 



FIG. 1G 

Prior Art 



Write, 600 bytes 




210W 



242s 



Write WR 
Completion 



CQE 




CQ 



Write (Tagged, SN=500). 

Write (Tagged, SN=700)_ 

"—Write (Tagged, SN=900, Last} 

TCP Ack, SN=700" 
TCPAck, SN=900" 




Region reffered by 
DataSink STag 



240 



204 / Read WR P osted 
\ f A by consumer 

^208R 




216R 



Read, 600 bytes 



( 



222 



208RR 



232 



-Read Req (UntaggedJ^SO) 
TCP Ack, SN=950' 



2\ 



Read Resp WR 
posted by hardware 



FIG. 1H 

Prior Art 

216RR 



210R 



Region referred by 
DataSink STag 



Read WR 
Completion 




.Read Resp (Tagged,SN=300) i 
jRead Resp (Tagged,SN=600,Last)| 



"TCP Ack, SN=600_ 

206 





Region referred by 
DataSink STag 



240 



FIS920030289US1 



6/17 





























CO 




c 








\— 




(0 




CD 




Q 





c 

CO 

CO 

• 

CO 

Q 



ml 

0 
*= 
13 

CO 
CO 
CO 

Q 



< 

(N 

d 



A" 



H 

o 

z 

a: 



o 
'en 
o 
_i 

•4— ' 

o 



-O 

E 

a> 

CO 
CO 

CD co 
CD 

a: 



52 



A" 



(Ml 
*l 

■R 

-4— • 

c 
o 
O 

c 

o 

■■s 

C 

c 
o 
O 



CO 

I 

00 col 

CO 

-*— < 

(0 

Q 



91 



c 
ID 

c 

o 

CO 

;g 
"co 

> 



Ml 



Ml 

a> 
o 

•g 

CD 
-♦— « 
C 



5 





©1 




col 




2 








» 

C 




o 




O 




CO 




co 




0) 




o 




a 




< 



Ml 
Ml 

03 



5 



CD 
O 
CO 

clI 

CO 

l_ 

<D 
CO 

Z> 



(01 
Ml 

a) 

"O 

o 



CO 

c 

CD 



(01 

*l 

'c/T 

» 

c 

0 

c 
o 

E 
o 
O 
u. 
a) 



/ 



Data Source 1 2 


Data Buffers 50 






Data Transfer 14A J 











FIS920030289US1 



7/17 



o 
d 




cm 



PQ 

d 



Oil 

3 
c 
o 
O 

c 
o 

"o 
0 
c 
c 
o 
o 



col 

CO 
CO 

Q 

» 

c 

c 

o 

o 

CD 



Ml 

<o| 

0) 
Q_ 

g 

0 
C 

c 
o 

o 



CM 
0) 
CM 

E 
z 

CO 

-*— » 

CL 

E 

0 

-4— • 

I 

CD 
> 
O 

o 

CD 



s 

CM 



% 

CD 
> 
O 

o 

CD 

q: 

-4— » 

C/) 

CO 



CO 
0> 
CM 

E 
z 

CO 
Q_ 

E 

CD 

I 

> 

8 

CD 

q: 

X 
CO 



00 

£ 
z 

CD 

■4—* 

CO 



o 

CM 

E 
z 

CD 
CO 



CM 
If) 
CM 

E 

z 

CO 



o 
o 

co 

E 
z 

CD 
CO 

c 
o 

Q_ 

CO 
CD 

"O 

CO 
CD 

q: 

c 

C 

0 

0- 



CM 
O 

CO 

E 
z 

CO 

c 

0 
CO 

"D 
0 

0 
Q_ 

E 

o 
O 



CO 

© 

CO 

E 

z 

0 

CO 

c 
o 

Q_ 

CO 
0 

"D 
CO 
0 

C£ 

TD 
0 

0 
CL 

E 
o 
O 



FIS920030289US1 



8/17 



FIG. 3 



S1 



S3 






Place segment to the 


Yes 


reassembly buffers, 


consider successful 




receipt, if connection 




Fast, downgrade it 




to Slow 



S11 




S7 



Process segment at fast 
path, place received 

segment to the 
destination buffers 




S13 

Intermediate^ 
j)r Last DDP Segment has^ 
invalid CRC 



S9 



Drop the TCP segment, 
do not confirm 
segment reception 



x DDP x 
i-leader is referred by 
sMPA Length of previous, 
segment 



No 



S10 



Yes 



DDP 

Header is referred by 
Marker 



No 



FIS920030289US1 



9/17 

FIG. 4A 

S101 

\s Good DDP Segment^ 
No 



Increase RecoveryAttemptsNum, 
AND update LastRecoverySN to 
carry largest SN of previously 
received segment and newly 
received error-including data 
transfers 



S103 

'RecoveryAttem ptsN u m 
> 

MaxRecoveryAttemptsNunr 



put segment to reassembly 
buffer, schedule Ack, 
downgrade connection to Slow 



S102 

is 



No 



S104 



Drop TCP segment, 
do not confirm 
reception 



S105 



I 



<^sTof FIG^) 



FIG. 4B 



for each TCP segment 



S105 

TnOrderTCPSegmentSN 
> LastRecoverySN 



Yes 



S106 



Reset 

RecoveryAttemptsNum 



No 



FIS920030289US1 



10/17 




FIS920030289US1 



11/17 




FIS920030289US1 



12/17 



FIG. 7 



0 12 3 

0 12345678901234567890 1234567890 1 



Key (16 bytes containing "MPA ID Req Fra 


me") 

CF - 


M 


C 


Res 


Rev 


PD_Length 


Private Data 



150 



\ 

152 



FIS920030289US1 



13/17 



FIG. 8 



^S104 

Word holds MPA 
Length Field 



S102 



Pick MPA Length Field 
from next word 



S106^ 




- I 


Use MPA Length Field 
to find CRC data 




FIS920030289US1 



14/17 

FIG. 9 



Yes 


Other 




Method 




FIS920030289US1 



15/17 

FIG. 10 




S158 



Process segment at fast 
path, place received 

segment to the 
destination buffers 



Drop the TCP segment, 
do not confirm segment 
reception (Send NACK), 
increase RecoveryAttemptsNum 
update LastRecoverySN to 
carry largest SN 



FIS920030289US1 



16/17 



FIG. 1 1 




Read WR posted 
by consumer 



21 6R ^208R 



Read, 600 bytes 



-232 



210R 



Region referred by 
DataSink STag 



ReadWR 
Completion 




240 



( 



222 



-Read Req (Untagged, SN=950) 



.TCPAck, SN=950 
.Read Resp (f agged,SN=300) 
iRead Resp (Tagged,SN=600,Last) 

( — TCPAck,SN=600. 

206 



208RR 



A. 



Read Resp WR 
posted by hardware 



216RR 





414 



Region referred by 
DataSink STag 



FIS920030289US1 



17/17 



N2R_1 N 



P2R 2 S 



N2R_2 S 



P2R_3 N 



N2R 4 S 



402 
402 
,400 

,400 ) 130A 
.402 
.402 

.400 
400 V130B 



FIG. 12 



402 



Legend 



T-^402 130C 

%400^ J 

Y N2R_n - 



received WQE 



missing WQE 



400 Y INZK - n " NextToReceive pointer of TCP hole #n 
J P2R_n - PreviousToReceive pointer of TCP hole #n 



FIG. 13 



500 508S 

\ ) Send WR posted 




Send WR 
Completion 



540 



508R 



Requester RNIC Responder 

36 220 

/ 

Send (Untagged, SN=100) 

Send (Untagged, SN=200) 

Send (Untagged, SN=300, Last 

TCPAck, SN=200 
TCPAck, SN=300 



Receive WR posted 
by consumer 



516R 





240 



Receive WR 
Completion 



FIG. 14 



Reference Counter 544 



CQE Type Indicator 546 



542 



